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Section 22 



Stochastic Processes. Brownian 
Motion. 



We have developed a general theory of convergence of laws on (separable) metric spaces and in the following 
two sections we will look at some specific examples of convergence on the spaces of continuous functions 
(C[0, 1],|| • II oo) and (C(M+),(i), where is a metric mctrizing uniform convergence on compacts. These 
examples will describe a certain central limit theorem type results on these spaces and in this section we 
will define the corresponding limiting Gaussian laws, namely, the Brownian motion and Brownian bridge. 
We will start with basic definitions and basic regularity results in the presence of continuity. Given a set T 
and a probability space (Q, P), a stochastic process is a function 



such that for each t G T, : 17 ^ M is a random variable, i.e. a measurable function. In other words, a 
stochastic process is a collection of random variables indexed by a set T. A stochastic process is often 
(Icfiucd by specifying finite dimensional (f.d.) distributions Pf = i^{{Xt}teF) for all finite subsets F C T. 
Kolmogorov's theorem then guarantees the existence of a probability space on which the process is defined, 
under the natural consistency condition 



One can also think of a process as a function on with values in M.'^ = { f : T ^ M}. because for a fixed 
CO e Q,Xf{u!) G is a (random) function of t. In Kolmogorov's theorem, given a family of consistent f.d. 
distributions, a process was defined on the probability space (]R^,Bt), where Bt is the cylindrical <T-algebra 
generated by the algebra of cylinders B x M^\^ for Borel sets B in and all finite F. When T is uncountable, 
some very natural sets such as 



might be not measurable on Bt- However, in our examples we will deal with continuous processes that 
possess additional regularity properties. 

Definition. If (T, d) is a metric space then a process is called sample continuous if for all w & fl, 

Xt{uj) g C(T, d) - the space of continuous function on (T, d). The process X^ is called continuous in probability 

if Xt Xtg in probability whenever t ^ Iq. 

Example. Let T = [0,1], {fl,P) — ([0,1], A) where A is the Lebesgue measure. Let Xt{oj) = l{t = oj) and 
Xl{u)) = 0. F.d. distributions of these processes are the same because for any fixed t G [0, 1], 



Xt{co) = X{t,co) -.Txn-^R 



-Fi C F2 ^ Pfi = Pf. 




F{Xt = 0) = ¥{X't = 0) = 1. 
However, F{Xt is continuous) = but for X'^ this probability is 1. 



□ 
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Definition. Let (T, d) be a metric space. The process Xt is measurable if 

is jointly measurable on the product space {T,B) x {fl,J^), where B is the Borel tr-algebra on T. 

Lemma 44 // (T, d) is a separable metric space and Xt is sample continuous then Xt is measurable. 

Proof. Let {Sj)j>i be a measurable partition of T such that diam(5j) < ^. For each non-empty Sj, let us 
take a point tj G Sj and define 

X^ito) = Xt.{cj) for teSj. 
X^{u) is, obviously, measurable on T x because for any Borel set A on M, 

{{cv,t) : X^{uj) gA} = \J{u : Xt.{w) G a} x Sj. 
Xt{w) is sample continuous and, therefore, Xt{oj) Xt{co) for all {ui,t). Hence, X is also measurable. 

□ 

If (T, d) is a compact metric space and Xt is a sample continuous process indexed by T then we can 
think of Xt as an element of the metric space of continuous functions {C{T,d), \\ ■ \\oo), rather then simply 
an element of K^. We can define measurable events on this space in two different ways. On one hand, we 
have the natural Borel cr-algebra B on C(T) generated by the open (or closed) balls 

Bgis) = {f€C{T):\\f-g\\^<e}. 

On the other hand, if we think of C(T) as a subspace of M^, we can consider a cr-algebra 

St = {BnC(r) iSefir} 

which is the intersection of the cylindrical cr-algebra Bt with C{T). It turns out that these two definitions 
coincide. An important implication of this is that the law of any sample continuous process Xt on (T, d) is 
completely determined by its finite dimensional distributions. 

Lemma 45 // (T, d) is a separable metric space then B = St- 

Proof. Let us first show that St C B. Any element of the cylindrical algebra that generates the cylindrical 
cr-algebra Bt is given by 

B X M^\^ for a finite F C T and for some Borel set BCR^. 

Then 

{B X M^\^) f|C(T) = |x G C{T) : {xt)teF G s} = {tt^ (x) G B} 

where irp : C{T) M.^ is the finite dimensional projection such that TrF{x) = {xt)teF- Projection ttf is, 
obviously, continuous in the || • ||oo norm and, therefore, measurable on the Borel a-algebra B generated by 
open sets in the || • norm. This implies that {^'Kp{x) G S} G B and, thus, St C B. Let us now show that 
B C St- Let T' be a countable dense subset of T. Then, by continuity, any closed e-ball in C{T) can be 
written as 

{fGC{T):\\f-g\U<e)= fj {/ S C(T) : \f(t)-g{t)\<e]eST 

teT' 

and this finished the proof. 

□ 

In the remainder of the section we will define two specific sample continuous stochastic processes. 
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Brownian motion. Brownian motion is a sample continuous process Xt onT = IR+ such that (a) the 
distribution of Xt is centered Gaussian for each t > 0; (b) Xq = and EX^ = 1; (c) if t < s then Xt and 
Xg — Xt are independent and jC{Xs — Xt) = C{Xg_t). If we denote cr^(t) = Var(Xj) then these properties 
imply 

a'^int) = na^(t), — ) = —a'^it) and a^(qt) = qa'^it) 

for all rational q. Since cr^(l) = 1, a'^[q) = q for all rational q and, by sample continuity, cr^(f) = t for all 
t>0. Therefore, for s <t, 

EXgXt = EXg{Xs + {Xt - Xg)) = s = min(i, s). 

As a result, we can give an equivalent definition. 

Definition. Brownian motion is a sample continuous centered Gaussian process Xt for t £ [0, oo) with 
the covariance Cov(Xt, Xg) = mm{t, s). 

Without the requirement of sample continuity, the existence of such process follows from Kolmogorov's 

theorem since all finite dimensional distributions are consistent by construction. However, we still need to 
prove that there exists a sample continuous version of the process. Wc start with a simple estimate. 

Lemma 46 // /(c) = Af{0, l)(c, oo) is the tail probability of the standard normal distribution then 

/(c) < for all c> 0. 

Proof. We have 

/(c) = —;= I e 2 dx < —;= \ -e ^ dx= —;=-e 2 . 

^/2tI Jc ~ V2tT Jc C ^ C 

If c > 1/^/2tt then /(c) < exp(— c^/2). If c < 1/\/2tt then a simpler estimate gives the result 

/(c)</(0) = ^<exp(^i(^)^)<e-4. 

□ 

Theorem 54 There exists a continuous version of the Brownian motion. 

Proof. It is obviously enough to define Xt on the interval [0, 1]. Given a process Xt that has f.d. distributions 
of the Brownian process but is not necessarily continuous, let us define for n > 1, 

Vk = Xk+i ~ Xj^ for A; = 0,...,2"-l. 

2" 2" 

The variance Var(Vfe) = 1/2" and, by the above lemma, 

p(max|F.| > ^) < 2"p(|y,| > -) < 2-^exp(--^). 

The right hand side is summable over n>l and, by the Borcl-Cantelli lemma, 

p(|max|Vfe| > ^1 i.o.) = 0. (22.0.1) 

Given t € [0, 1] and its dyadic decomposition t = X^^i 20 ^™ ^'o '= {0; l}i let us define t{n) = X)j=i 2J ®° 
that 

Xtin) - Xt^n-1) G {0} U {Vfc : A: = 0, . . . , 2" - 1}. 

Then, the sequence 

Xt{n) = + ^ {Xt(j) - Xt(j-i)) 
l<j<n 
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converges almost surely to some limit because by (22.0.1) with probability one 

\^t{n) - ^t(n-\) \ < f^~'^ 

for large enough (random) n > no{u}). By construction, Zt = Xf on the dense subset of all dyadic t e [0, 1]. 
If wc can prove that Zi is sample continuous then all f.d. distributions of Zt and Xt will coincide, which 
means that Zt is a continuous version of the Brownian motion. Take any s G [0, 1] such that \t~ s\ < 2~". 
If t{n) = ^ and s(n) = then |A; — m| e {0, 1}. As a result, \Xt(n) — -^s(ra)| is either equal to or one of 
the increments \Vk\ and, by (22.0.1), \Xt^n) — Xs{n)\ < '^"^ for large enough n. Finally, 

\Zt — Zs\ < \Zt — Xt(^„)\ + \Xt(n) — ^s{n)\ + \^s{n) — Zs\ 

El 1 ^ < ^ 

P ^2 ;2 - ^ 

l>n l>n 

which proves the continuity of Zf. On the event in (22.0.1) of probability zero we set Zt = 0. 

□ 

Definition. A sample continuous centered Gaussian process Bt for t € [0, 1] is called a Brownian bridge if 

EBtB^ = s(l - t) for s<t. 

Such process exists because if Xt is a Brownian motion then Bt = Xt — tXi is a Brownian bridge, since for 

s <t, 

EB^Bt = E{Xt - tXi){X, - sXi) = s-st-ts + st = s{l-t). 
Notice that Bq = Bi = 0. 
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